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Abstract 

An important goal in neural map learning, which can conveniently be accomplished 
by magnification control, is to achieve information optimal coding in the sense of 
information theory. In the present contribution we consider the winner relaxing ap- 
proach for the neural gas network. Originally, winner relaxing learning is a slight 
modification of the self-organizing map learning rule that allows for adjustment of 
the magnification behavior by an a priori chosen control parameter. We transfer this 
approach to the neural gas algorithm. The magnification exponent can be calculated 
analytically for arbitrary dimension from a continuum theory, and the entropy of 
the resulting map is studied numerically conf irming the theoretical prediction. The 
influence of a diagonal term, which can be added without impacting the magnifica- 
tion, is studied numerically. This approach to maps of maximal mutual information 
is interesting for applications as the winner relaxing term only adds computational 
cost of same order and is easy to implement. In particular, it is not necessary to 
estimate the generally unknown data probability density as in other magnification 
control approaches. 

Key words: Neural gas, Self-organizing maps. Magnification control. Vector 
quantization 



1 Introduction 



Neural maps are a widely ranging class of neural vector quantizers which 
are commonly used e.g. in data visualization, feature extraction, principle 
component analysis, image processing, and classification tasks. A well studied 
approach is the Neural Gas Network (NG) [21]. An important advantage of 
the NG is the adaptation dynamics, which minimizes a potential, in contrast 



to the self-organizing map (SOM) [17] frequently used in vector quantization 
problems. 

In the present paper we consider a new control scheme for the magnification of 
the map [2,10,12,20,24,27]. Controlling the magnification factor is relevant for 
many applications in control theory or robotics, were (neural) vector quan- 
tizers are often used to determine the actual state of the system in a first 
step, which is an objective of the control task [31,27]. For instance, in [28] 
was demonstrated that the application of a magnification control scheme for 
the neural gas based classification system of position and movement state 
of a robot can reduce the crash probability. Another area of application is 
information-theoretically optimal coding of high- dimensional data as occur in 
satellite remote sensing image analysis of hyperspectral images [22,30] which 
is, in fact, the task of equiprobabilistic mapping [26]. Further applications 
can be found in medical visualization and classification tasks [32]. Generally, 
vector quantization according to an arbitrary /^-norm can be related to the 
problem of magnification control as it is explained below. 



2 The neural gas network 



The NG maps data vectors v from a (possibly high-dimensional) data manifold 
V CR'^ onto a set A of neurons i, formally written as "^v^a : T> ^ A. Each 
neuron i is associated with a pointer Wj eR'^ also called weight vector, or 
codebook vector. All weight vectors establish the set W = {wi}-g^. The 
mapping description is a winner take all rule, i.e. a stimulus vector v G P 
is mapped onto the neuron s E A the pointer of which is closest to the 
actually presented stimulus vector v, 

^v-^A : V I— > s (v) = argmin ||v — Wi|| . (1) 

The neuron s (v) is called winner neuron. The set 

= {veP|*^,_A(v) =0 (2) 



is called (masked) receptive field of the neuron i. 

During the adaptation process a sequence of data points v e P is presented 
to the map with respect to the stimuli distribution P{V). Each time the 
currently most proximate neuron s according to (1) is determined, and the 
pointer as well as all pointers w, of neurons in the neighborhood of are 
shifted towards v, according to 

Awi^ehx{i,v,W){Y-Wi). (3) 
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The property of "being in the neighborhood of w^" is represented by a neigh- 
borhood function hx {i, v, W). The neighborhood function is defined as 

/i,(z,v,W) = exp[-M^V (4) 



where ki (v, W) is defined as the number of pointers Wj for which the relation 
||v — Wjll < ||v — Wj|| is vahd, i.e. ki(y,W) is the winning rank [21]. In 
particular, for the winning neuron s we have hx (s, v, W) = 1.0. We remark 
that in contrast to the SOM the neighborhood function is evaluated in the 
input space. Moreover, the adaptation rule for the weight vectors in average 
follows a potential dynamics [21]. 

The magnification of the trained map reflects the relation between the data 
density P (V) and the density p of the weight vectors [23] . For the NG the 
relation 

p (w) oc P (P)"^'^ (5) 



with 



d + 2 



(6) 



has been derived [21]. The exponent q;ng is called magnification factor. For 
the NG it depends on the intrinsic dimensionality d of the data which can 
be numerically determined by several methods [5,6,7,14,25]. For simplicity we 
further require that the (embedding) data dimension is the intrinsic one. 

Generally, the information transfer is not independent of the magnification 
of the map [33]. It is known that for a vector quantizer (or a neural map 
in our context) with optimal information transfer the relation a = 1 holds. 
Otherwise, a vector quantizer which minimizes the mean distortion error 



= J ||w, - v|rP(v)(iv (7) 

V 



has the magnification factor 
d 

a = 8 

d + -f ^ ^ 



with V eT> C R'^, i.e. the magnification of a vector quantizer is directly related 
to the minimization of the description error according to a certain Zp-norm [33]. 
Hence, the NG minimizes the usual E2 distortion error. 
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We now address the question how to extend the NG to achieve an a priori 
chosen optimization goal, i.e. an a priori chosen magnification factor. 



3 Controlling the magnification in NG 

For the SOM several methods exist to control the magnification of the map. 
The first approach to infiuence the magnification of a learning vector quantizer, 
proposed in [13] is called the mechanism of conscience. For this purpose a bias 
term is added in the winner rule (1): 

'i/v-.A : V 1-^ s (v) = argmin - Wj || - 7 (^-^ - p.^ ^ (9) 

where pi is the actual winning probability of the neuron i and 7 is a balance fac- 
tor. Hence, the winner determination is influenced by this modiflcation. The al- 
gorithm should converge such that the winning probabilities of all neurons are 
equalized. This is related to a maximization of the entropy and consequently 
the resulting magnification is equal to unity. However, as pointed out by [26], 
adding a conscience algorithm to the SOM does not equate to equiprobabilis- 
tic mapping, in general. Only for very high dimensions, a minimum distortion 
quantizer (such as the conscience algorithm) approaches an equiprobable quan- 
tizer ([26] - page 93). Further, an arbitrary magnification cannot be achieved 
by this mechanism. Moreover, numerical studies of the algorithm have shown 
instabilities [26]. To control the magnification, a local learning parameter was 
introduced [1] into the usual SOM-learning scheme. The now locahzed learning 
allows in principle an arbitrary magnification. Other authors proposed vari- 
ants which lead more away from the original SOM by kernel methods [26] or 
statistical approaches [19]. 

For the NG a solution of the magnification control problem can be realized 
by introducing an adaptive local learning step size e<j(v) [27] according to the 
above mentioned approach for SOM [1]. Then, the new localized learning rule 
reads as 

A Wj = e,(v)/iA (i, V, W) (v - Wi) (10) 

with the local learning parameters = e (wj) depending on the stimulus 
density P at the position of the weight vectors Wj via 

(q) = eoP (w,)"^ . (11) 

The brackets (. . .) denote the average in time, and s (v) is the best-matching 
neuron with respect to (1). Note, that the local learning rate es(v) of the 
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winning neuron is applied in the adaptation step (10) for each neuron. This 
approach finally leads to the new magnification law 



a' — aNG ■ {m 



(12) 



which is a modification of the old one. Hence, the parameter m plays the role 
of a control parameter. 

However, in real applications one has to estimate the generally unknown data 
distribution P. Usually this is done by estimation of the volume of the receptive 
fields and the firing rates [1,29]. This may lead to numerical instabihties of the 
control mechanism [15,26,31]. Therefore, an alternative control mechanism is 
demanded. 

Recently, a new approach for magnification control of the SOM was introduced 
[8,9] which avoids the P-estimation problem. The respective approach is a 
generalization of a modification of the usual SOM [16]. It is called (generalized) 
Winner Relaxing SOM (WRSOM) [8,9]. In winner relaxing SOM an additional 
term occurs in weight vector update for the winning neuron, implementing 
a relaxing behavior. The relaxing force is a weighted sum of the difference 
between the weight vectors and the input according to their distance rank. The 
relaxing term was originally introduced in [16] to obtain a learning dynamic 
for SOM according to an average reconstruction error including the effect of 
shifting Voronoi borders. 

It was shown that the generalized winner relaxing mechanism applied in WR- 
SOM can be used for magnification control in SOM, too [8]. Thereby, the 
winner relaxing approach provides a magnification control scheme for SOM 
which is independent of the shape of the data distribution only depending on 
parameters of the winner relaxing term. 



3.1 The winner relaxing neural gas 

We now transfer the generalized winner relaxing approach for SOM to the 
NG and consider its infiuence on the magnification. In complete analogy to 
the WRSOM we add a general winner relaxing term R (^, k) to the usual 
NG- learning dynamic (3). Then the weight update reads as 



Awi = ehx {i, V, W) (v -Wi) + R (C, k) , 



(13) 



whereby the winner relaxing term is defined as 



R it «) = (C + 1^) (V - Wi) - k6,s {j, V, W) (V - MVj) 



(14) 



j 
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depending on the additional weighting parameters ^ and k. We refer to this 
algorithm as the winner relaxing NG (WRNG). The original winner relaxing 
term described in [16] is obtained for the special parameter choice ^ — 0, k = ^. 
Note, that the relaxing term only contributes to the winner weight vector 
update as in the original approach. 



3.2 Derivation of the Magnification for WRNG 

We now derive a relation between the densities p and P in analogy to [21] for 
the winner relaxing learning (13). The procedure is very similar as in [21,27]. 
The average change (Awj) for the winner relaxing NG learning rule (13) is 

(Aw,) =JP{^) hx (^, V, W) (v - w,) + {^ + k) -Sis ■ (v - w,) 

-5isK hx {j, V, W) (v - Wj) dv. (15) 
j 

We now consider the equihbrium state, i.e. (Awj) = 0. 
For this purpose, we first separate the integral (15) into 

(Awi) ^h + h + h (16) 

with 

h^JP (v) hx {i, V, W) (v - W,) dY, (17) 
h^JP (v) (e + «) -Sis ■ (v - w,) dw (18) 



and 



h^-JPM SisK ^ hx {j, V, W) (v - w,) dv (19) 



The integral Ii is the usual one according to the NG dynamics whereas I2, I3 
are related to the winner relaxing scheme. In the following we treat each inte- 
gral in a separate manner. Thereby we always assume a continuum approach, 
i.e. the index i becomes continuous. Hence, for a given input v one can find 
an optimal fulfiUing even = v [24] . 

Doing so, the /2-integral vanishes in the (first order) continuum limit because 
the integration over 5is only contributes for Ws, but in this case (v — Ws) = 
holds. 
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We now pay attention to the /3-intcgral: The continuum assumption made 
above allows a turn over from sum J2j h\ v, W) (v — Wj) to the integral 
form / h\ (w, v, W) (v — w) dw in (19). The further treatment is in complete 
analogy to the derivation of the magnification in the usual NG [21]. Let r be 
the difference vector 

r = V - Wj (20) 



The winning rank ki (v, W) only depends on r, therefore we introduce the 
new variable 

x(r) = f • ki (r)^ (21) 



which can be assumed as monotonously increasing with ||r||. Thus, the inverse 
r (x) exists and we can rewrite the /3-integral (19) into 



h = j P (v) 5isn \j hx (x) • r (x) ■ J (x) dx 



dv 



(22) 



with the d x d-Jacobian-matrix 

J(x)=dat(|j). (23) 



I3 only contributes to (Awj) for the winning weight (realized by Sis), i-e., for 
Wj = Wg which is equal to v according to the continuum approach. Hence, the 
integration over v yields 

73 = i^P (w,) • y /lA (x) • r (x) • J (x) dx (24) 



If hx (kj (r)) rapidly decreases to zero with increasing r, we can replace the 
quantities r (x) , J (x) by the first terms of their respective Taylor expansions 
around the point x = neglecting higher derivatives. We obtain 

xW^r(.,p(w.))j(l + l^ + 0(r^)) (25) 

which corresponds to 

r (x) = X (r,p (w,))-^ (^1 - (r,p (w,))"^ • ^^^^ + O (x^)) (26) 

with Td — TT^/r (^^ + ij as the volume of a d-dimensional unit sphere [21]. 
Further, 
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J(x)=(j(0)+x.^ + ...) (27) 



= (r, . p)-' ^1 - (r, . p)- J (l + i) . X . j + O (x') (28) 
and, hence, 



dJ_ 



= -(r.-p)-(-^)^. (29) 

x=0 P 



Therefore, the integral in equation (24) can be rewritten as 

h^e'KP{Td-p)--^ y'/iA(x)-x- (30) 
.((..p)-'-(l.i)(...)-(-«.x.^^ + ...) 



'l-(r.-p)-^-x-|^ + ...j dx 



The integral terms in (30) of odd order in x vanish because of the rotational 
symmetry of h\ (x). Then (24) yields, neglecting terms in higher order in x, 

d + 2drp , . 

/g = e kP— 1 (31) 

a p 



with 



{'^d ■ p) 



j+d hx (x) • ||x||^ dx. (32) 

d J 



d 

V 



It remains to consider the Ji-integral. As mentioned above, it is identical to 
the averaged adaptation of the usual NG. Hence, the treatment can be taken 
from there and we get 

,33, 



as an equivalent equation [21]. 

Taking together (33) and (31), the stationary solution of (13) is given by 

(Aw.)=0 = c).P-P.!^.^ + F.^^ (34) 

dp dp 
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This differential equation rouglily lias the same form as the one for the usual 
Neural Gas (33). Its solution is given by 

p oc p«WRNG (35) 



with the exponent 

«WRNG = (36) 



being the magnification factor. Hence, the magnification factor of the WRNG 
can be described also in terms of the magnification of the usual neural gas 

aWRNG — r. ttNG (37) 

i — K 



Note, that the parameter ^ of the winner relaxing term R{^,k) does not 
influence the magnification. 



3.3 Discussion of the theoretical result and comparison with winner relaxing 
SOM 



Two direct observations can be immediately made: Firstly, the magnification 
exponent appears to be independent of the additional diagonal term (con- 
trolled by ^) for the winner which is in agreement with the WRSOM result 
[8]. Therefore ^ = again is the usual setting in WRNG for magnification con- 
trol. Secondly, by adjusting n appropriately, the magnification exponent can 
be adjusted, e.g. to the most interesting case of maximum mutual information 
[18,33]. Maximum mutual information, which corresponds to optimal informa- 
tion transfer, is obtained when magnification equals the unit [3,4]. Hence, we 
have for this case the optimum value 

«opt = (38) 



If the same stability borders \k\ = 1 of the WRSOM also arc valid here, one 
can expect to increase the NG exponent by positive values of n, or to lower 
the NG exponent by a factor 1/2 for k, — —1. In contrast to the Winner 
Enhancing SOM, where the relaxing term has to be inverted (k < 0) to in- 
crease the magnification exponent, for the neural gas positive values of k, are 
required to increase the magnification exponent. However, the magnification 
factor still remains dependent on the generally unknown (intrinsic) dimension 
of the data. If this dimension is known, the parameter k can be set a priori 
to obtain a neural gas of maximal mutual information. In this approach it is 
not necessary to keep track of the local reconstruction errors and firing rate 
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for each neuron to adjust a local learning rate. Possibilities for estimating the 
intrinsic dimension are the well-known Grassberger-Procaccia-analysis [14] or 
the neural network approach using again a NG [5]. 

However, one has to be cautious when transferring the A — > result obtained 
above (which would require to increase the number of neurons as well) to a 
realistic situation where a decrease of A with time will be limited to a final 
finite value to avoid the stabihty problems found in [15]. If the neighborhood 
length in SOM is kept small but fixed for the limit of fine discretization, the 
neighborhood function of the second but one winner will again be of order 1 
(as for the winner). For the NG however the neighborhood is defined by the 
rank list. As the winner is not present in the I2 + h integral, all terms share 
the factor e"'^ by hx{k) — e~^hx{k — 1) which indicates that in the discretized 
algorithm k has to be rescaled by e"^^ to agree with the continuum theory. ^ 



4 Numerical results 

A numerical study shows how the winner-relaxing mechanism is able to control 
the magnification for optimization of the mutual information of a map gener- 
ated by the WRNG. Using a standard setup as in [15] of = 50 Neurons and 
10^ training steps with a probability density P{xi . . .Xd) = Hi sin(7ra;j), with 
fixed A = 1.5 and e decaying from 0.5 to 0.05, the entropy of the resulting map 
computed for an input dimension of 1, 2 and 3 is plotted in Fig. 1. Thereby, 
the entropy is computed using the winning probabilty pi of the neurons: 

N 

H^-Y,pM{Pi) (39) 

j=i 

The entropy shows a dimension- dependent maximum approximately aX k — 
^^e'^. The scaling of the position of the entropy maximum with input dimen- 
sion is in agreement with the continuum theory, as well as the prediction of 
the opposite sign of k that has to be taken to increase mutual information. 
Our numerical investigation indicates that the above discussed prefactor, in 
fact, has to be taken in account for finite A and a finite number of neurons. 
We obtain, within a broad range around the optimal k the entropy is close to 
the maximum Pi ln(i-*j) — In(A^) given by information theory. 

In a second numerical study wc investigate the infiuence of the additional 
diagonal term (controlled by ^) for the winner. Already for the WRSOM 
the magnification exponent is independent of this diagonal term [8]. In the 
respective derviation (72-integral (18)) only first order approximations were 

^ In particular, for a finite A the maximum coefficient h\ that contributes to the 
I2 + I3 integral is given by the prefactor of the second but one winner, which is 
given by e^. 
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Fig. 1. Plot of the entropy H according (39) curves for varying values of k for 
one- (o), two- (+), and three-dimensional (□) data. The entropy has the maxi- 
mum ln(50) ~ 3.912 if the magnification equals unity [33]. The arrows indicate the 
rescaled Kopt-values for the respective data dimensions. 

used. Otherwise, I2 may contribute in higher orders. To verify that the con- 
tribution of an additionally added diagonal term is marginal, the entropy was 
calculated both for ^ = and (k + ^) =0 [11]. However, no influence on the 
entropy was found for the choice k + C = instead of ^ = 0. (Fig 2). More 
pronounced is the influence of the diagonal term on stability; according to the 
larger prefactor no stable behavior has been found for |^| > 1, therefore ^ = 
is the recommended setting. 



5 Conclusions 

We introduced a winner-relaxing term in neural gas algorithm to obtain a 
winner-relaxing neural gas with the possibility of magnification control. The 
winner relaxing scheme is adopted from winner-relaxing SOM. The new con- 
trolling scheme offers a method which is independent on the explicit knowledge 
of the generally unknown data distribution which is an advantage in compari- 
son to the earlier presented neural gas with localized learning for magnification 
control. In particular, we avoid the difficult determination of the data proba- 
bility density by estimation of the volume of the receptive fields of the neuron 
and the firing rate. Numerical simulations show the abilities of the proposed 
algorithm. 
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Fig. 2. Comparison of the entropies curves for different K-values for ^ = (straight) 
and + k) = (dashed) with respect to one- (o), two- (-I-), and three-dimensional 
(□) data. 

Acknowledgements: The authors want to thank Th.Martinetz and H.Ritter 
for detailed comments and intensive discussions. 



References 



[1] H.-U. Bauer, R. Der, and M. Herrmann, Controlhng the magnification factor 
of self-organizing feature maps. Neural Computation 8 (1996) 757-771. 

[2] C. M. Bishop, M. Svensen, and C. K. I. Williams. Magnification factors for the 
SOM and GTM algorithms. In Proceedings of WSOM'97, Workshop on Self- 
Organizing Maps, Espoo, Finland, June 4-6, (Helsinki University of Technology, 
Neural Networks Research Centre, Espoo, Finland, 1997), 333-338. 

[3] R. Brause. Optimal information distribution and performance in 
neighbourhood-conserving maps for robot control. Int. J. Computers and 
Artificial Intelligence 11 (1992) 173-199. 

[4] R. W. Brause, An approximation network with maximal transinformation, 
in M. Marinaro and P. G. Morasso, editors, Proc. ICANN'94, International 
Conference on Artificial Neural Networks, volume I, (London, UK, 1994. 
Springer), 701-704. 

[5] J. Bruske and G. Sommer, Dynamic cell structure learns perfectly topology 
preserving map. Neural Computation 7 (1995) 845-65. 



12 



[6] F. Camastra and A. Colla, Data dimensionality estimation methods: a survey, 
Pattern Recognition 36 (2003) 2945-2954. 

[7] F. Camastra and A. Vinciarelli, Intrinsic dimension estimation od data: an 
approach based Grassberger-Procaccia's algorithm, Neural Processing Letters 
14 (2001) 27-34. 

[8] J. C. Claussen, Generalized winner relaxing Kohonen feature maps, e-print 
cond-mat (2002), ( |http://arXiv.org/abs/cond-ma t /0208414| . 

[9] J. C. Claussen, Winner relaxing and winner enhancing Kohonen maps: maximal 
mutual information from enhancing the winner, Complexity 8(4) (2003) 15-22. 

[10] J. C. Claussen and H. G. Schuster, Asymptotic level density of the elastic net 
self-organizing feature map, in J. Dorronsoro, editor, Proc. International Conf. 
on Artificial Neural Networks (ICANN) (Springer, Berlin 2002), Lecture Notes 
in Computer Science 2415, 939-944. 

[11] J. C. Claussen and T. Villmann, Magnification control in neural gas by winner 
relaxing learning: Independence of a diagonal term, in O. Kaynak, editor, 
Proc. International Conference on Artificial Neural Networks (ICANN'2003) 
(Istanbul, 2003), 58-61. 

[12] D. Dersch and P. Tavan, Asymptotic level density in topological feature maps, 
IEEE Trans, on Neural Networks 6 (1995) 230-236. 

[13] D. DeSieno, Adding a conscience to competitive learning, in Proc. ICNN'88, 
Int. Conf. on Neural Networks (1988). 

[14] P. Grassberger and I. Procaccia, Maesuring the strangeness of strange 
attractors, Physica D 9 (1983) 189-208. 

[15] M. Herrmann and T. Villmann, Vector quantization by optimal neural gas, 
in W. Gerstener, A. Germond, M. Hasler, and J.-D. Nicoud, editors. Artificial 
Neural Networks - Proceedings of International Conference on Artificial Neural 
Networks (ICANN'97) Lausanne, (Springer, Berlin 1997), Lecture Notes in 
Computer Science 1327, 625-630. 

[16] T. Kohonen, Self-Organizing Maps: Optimization approaches, in T. Kohonen, 
K. Makisara, O. Simula, and J. Kangas, editors. Artificial Neural Networks, 
volume II (1991), 981-990. 

[17] T. Kohonen, Self- Organizing Maps, (Springer, 1995). 

[18] R. Linsker, Towards an organizing principle for a layered perceptual network. 
In D. Z. Anderson, editor. Neural Information Processing Systems, (Amer. Inst. 
Phys., New York, NY, 1987), pages 485-494. 

[19] R. Linsker, How to generate maps by maximizing the mutual information 
between input and output signals. Neural Computation 1 (1989) 402-411. 

[20] S. P. Luttrell, Code vector density in topographic mappings: scalar case, IEEE 
Trans, on Neural Networks 2 (1991) 427-436. 

[21] T. M. Martinetz, S. G. Berkovich, and K. J. Schulten, 'Neural-gas' network for 
vector quantization and its application to time-series prediction, IEEE Trans, 
on Neural Networks 4 (1993) 558-569. 



13 



[22] E. Merenyi and A. Jain, Forbidden magnification? ii., In M. Verleysen, editor, 
European Symposium on Artificial Neural Networks 2004, (d-side publications, 
2004). 

[23] H. Ritter, Asymptotic level density for a class of vector quantization processes, 
IEEE Trans, on Neural Networks 2 (1991) 173-175. 

[24] H. Ritter, T. Martinetz, and K. Schulten, Neural Computation and Self- 
Organizing Maps: An Introduction, (Addison- Wesley, Reading, MA, 1992). 

[25] F. TaJiens. On the numerical determination of the dimension of an attractor, 
in B. Braaksma, H. Broer, and F. Takens, editors. Dynamical Systems and 
Bifurcations, (Springer, Berlin, 1985), Lecture Notes in Mathematics No. 1125, 
99-106. 

[26] M. M. van Hulle, Faithful Representations and Topographic Maps From 
Distortion- to Information-based Self- organization, (J. Wiley &; Sons, Inc., 
2000). 

[27] T. Villmann, Controlling strategies for the magnification factor in the neural 
gas network, Neural Network World 10 (2000) 739-750. 

[28] T. Villmann and A. Heinze, Application of magnification control for the neural 
gas network in a sensorimotor architecture for robot navigation, in H.-M. Grofi, 
K. Debes, and H.-J. Bohme, editors. Proceedings of Selbstorganisation Von 
Adaptivem Verfahren (SOAVE'2000) Ilmenau, Fortschrittsberichte des VDI 
(VDI-Verlag Diisseldorf, 2000), 125-134. 

[29] T. Villmann and M. Herrmann, Magnification control in neural maps, in Proc. 
Of European Symposium on Artificial Neural Networks (ESANN'98), (D facto 
pubHcations. Brussels, Belgium, 1998), 191-196. 

[30] T. Villmann, E. Merenyi, and B. Hammer, Neural maps in remote sensing 
image analysis, Neural Networks 16 (2003) 389-403. 

[31] T. Villmann, S. Schiinemann, and B. Michaelis, Two approaches to control the 
magnification factor in the topology representing neural network, GMD Report 
59 (1999) 44-55. 

[32] A. Wismiiller, F. Vietze, D. Dersch, J. Behrends, K. Hahn, and H. Ritter, 
The deformable feature map - a novel neurocomputing algorithm for adaptive 
plasticity in pattern analysis, Neurocomputing 48 (2002) 107-139. 

[33] P. L. Zador, As3niiptotic quantization error of continuous signals and the 
quantization dimension, IEEE Transaction on Information Theory 28 (1982) 
149-159. 



14 



